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DATA CHARGING SYSTEM, CONTENT GENERATOR. DATA CHARGING 
APPARATUS, AND DATA CHARGING METHOD 

BACKGROUND OF THE INVENTION 
TECHNICAL FIELD 

The present invention relates to a data charging system, 
content generator, data charging apparatus, and data 
charging method which provide data and programs to users 
via a network or recording medium and make a charge 
according to the amount of use. 

More particularly, the present invention relates to a data 
charging system, content generator, data charging 
apparatus, and data charging method .which apply a marking 
technique called data hiding or the like to charging for 
the use of data and programs. 

PRIOR ART 

Accounting methods are considered which involve 
distributing digital contents (also referred to simply as 
contents) such as software and programs to a user and 
charging when the user use any of the digital contents. 

For example, Japanese Published Examined Patent Application 
No. 6-95302 (Reference 1) discloses an accounting method in 
which one recording medium containing chargeable software 
and a usage charge list is distributed to the user and the 
user's data processing system processes his/her account by 
using that information. 

Also under consideration are accounting methods which 
combine the above-mentioned accounting method with a 
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recording medium capable of storing data on a built-in 
memory such as an IC card. 

For example, Japanese Published Examined Patent Application 
No. 6-19707 (Reference 2) discloses an accounting method 
which employs such an IC card. 

Also, a marking technique which involves embedding a 
visible or invisible data (a mark) called a digital 
watermark or the like has been developed to indicate the 
copyright holder of digital contents such as image data 
clearly or prevent their illegal use. 

For example, "Color correct digital watermarking of images" 
(Reference 3: U.S. Patent No. 5,53 0,759) and "Method and 
apparatus for reducing quantization artifacts in a 
hierarchical image storage and retrieval system" (Reference 
4: U.S. Patent No. 5,568,570) disclose marking techniques 
which involve embedding additional visible information in 
digital contents. 

Besides, "Scrambling Digital Image Data for Copyright 
Protection" (Reference 5: SCIS96-9A) discloses a scrambling 
technique for protecting digital contents from unauthorized 
use and "NIKKEI ELECTRONICS, No. 694, 7-14 (pp. 17-18), 
1997" (Reference 6) discloses an image delivery system 
which combines this scrambling technique with a 
watermarking technique for embedding additional invisible 
information in digital contents. 

c 
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The November 199 8 issue of "Nikkei Internet Technology" 
(Reference 7) carries an explanatory article about digital 
watermarking. 

5 Products, such as IBM DataHiding Plug -in for Adobe 

Photoshop for Macintosh, which employ such digital 
watermarking technology are on the market . 
However, since the accounting methods disclosed in 
References 1 and 2 need user- specif ic information for 
10 accounting, it is difficult to use these methods in 

combination with a recording medium called a smart card 
« which allows an IC card to be used in a manner similar to 

*sD currencies. 

"jj 15 Also, with the marking techniques disclosed in References 

p 3 to 6 , it will be possible to ask the user to pay prices 

fy for the use of digital contents in exchange for deletion of 

^ the mark in digital contents. 

20 According to such a method, however, the user have to 

y3 select whether to pay the full amount or pay no price 

depending on whether he/she uses digital contents or not. 

There is no way to charge the user on a pay-per-use basis 

according to the extent of use (usage time, usage count, 
25 amount of data used, etc.: hereafter referred to simply as 

usage) . 

The present invention has been made to solve the 
conventional problems described above. Consequently, an 
30 object of the present invention is to provide a data 

charging system, content generator, data charging 
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apparatus, and data charging method capable of charging 
the user for his/her use of digital contents in an easy 
and reliable manner by using a smart card.. 

Another object of the present invention is to provide a 
data charging system, content generator, data charging 
apparatus, and data charging method capable of charging the 
user for his/her use of digital contents on a pay-per-use 
basis . 

Still another object of the present * invention is to provide 
a data charging system, content generator, data charging 
apparatus, and data charging method capable of charging the 
user for his/her use of digital contents in an easy and 
reliable manner while preventing unauthorized use of 
digital contents by means for digital watermarking or the 
like . 

Summary of the Invention 

To attain the above-mentioned objects,, the present 
invention provides a data charging system which comprises 
a content generator for generating contents containing 
object data, a recording medium for recording the charging 
data used for charging for said object data and the 
recognition data used for recognition of the object data, 
and a data charging apparatus for charging for the use of 
said object data by using said charging data and said 
recognition data recorded, wherein said data charging 
apparatus comprises a data reading logic for reading said 
recognition data and said charging data from said recording 
medium, a separator for separating said object data from 
said contents, an recognition logic for recognizing said 
separated object data by using said recognition data read 



JA998-216 



out, an accounting logic for charging for the use of said 
recognized object data by using said charging data read 
out, and a writing logic for writing, as said charging 
data, the results of charging for the use of said 
5 recognized object data into said recording medium. 



Brief Description of the Drawings 

Preferred embodiments of the present invention will now 
be described, by way of example only, with reference to 
10 the accompanying drawings in which: 

Figure 1 illustrates the configuration of the data 
charging system according to the present invention; 

15 Figure 2 illustrates the configuration of the client 

machines and server machines shown in Figure 1; 

Figure 3 shows the configuration of the content generation 
program which runs on the server machine of Figures 1 and 
20 2 ; 

Figure 4 shows the watermark information added to contents 
by the content generation program of Figures 1 and 2; 



F-iqnT7P s .sluaw; — feb e charging data recorded on Lhe IC caid - 



25 shown in Figure l; 



Figure 6 shows the configuration of the 
watermarking/accounting program which runs on the client 
machine of Figures 1 and 2; 



30 



JA998-216 



-5- 



Figure 7 shows the configuration of the accounting engine 
shown in Figure 6; 

Figure 8 shows the content information output by the 
digital -watermarking engine of Figure 6 to the accounting 
engine; 

Figure 9 is a flowchart showing the watermarking process 
and detection/ removal process (digital -watermarking 
process: S10) performed by the digital -content receiving 
module and digital -watermarking engine of Figure 6; 

Figure 10 is a flowchart showing the watermarking process 
(S40 in Figure 9) of digital contents containing static 
image data; 

Figure 11 is a flowchart showing the watermarking process 
(S42 in Figure 9) of digital contents containing audio 
data; 

Figure 12 is a- flowchart showing the watermarking process 
(S44 in Figure 9) of digital contents containing dynamic 
image data; 

Figure 13 is a flowchart showing the watermarking process 
(S46 in Figure 9) of digital contents containing text data; 

Figure 14 is a flowchart showing the process (S30 in Figure 
9) of generating content information (Figure 8) from 
digital contents containing static image data; 
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Figure 15 is a flowchart showing the process (S32 in Figure 
9) of generating content information (Figure 8) from 
digital contents containing audio or dynamic image data; 

Figure 16 is a flowchart showing the process (S34 in Figure 
9) of generating content information (Figure 8) from 
digital contents containing text data; 

Figure 17 is a flowchart of the accounting process (S20) 
shown in Figure 9; and 

Figure 18 is a flowchart of the billing process (S24) shown 
in Figure 17. 

Detailed Description of the Preferred 
Embodiments of the Invention 

The content generator according to the present invention 
embeds digital watermarks in object data and generates 
contents in a data charging system which records, on a 
recording medium, the charging data used for charging for 
object data contained in said contents and the recognition 
data used for recognizing the object data and charges only 
for the use of the object data embedded with said digital 
watermarks by using said charging data and said recognition 
data recorded. 

In a data charging system which records, on a recording 
medium, the charging data used for charging for object data 
contained in said contents and the recognition data used 
for recognizing the object data and charges for the use of 
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said object data by using said charging data and said 
recognition data recorded; the data charging apparatus 
according to the present invention comprises a data reading 
logic for reading said recognition data and said charging 
data from said recording medium, a separator for separating 
said object data from said contents, an recognition logic 
for recognizing said separated object data by using said 
recognition data read out, an accounting logic for charging 
for the use of said recognized object data by using said 
charging data read out, and a writing logic for writing, as 
said charging data, the results of charging for the use of 
said recognized object data into said recording medium. 

Preferably, said contents comprise said object data and 
said recognition data for recognizing this object data, 
said separator separates said object data and said 
recognition data from said contents, said recognition logic 
recognizes said object data, based on said recognition data 
separated from said contents and on said recognition data 
read out from said recording medium, and said accounting 
logic charges for said object data by using, said charging 
data read out . 

Preferably, said data charging apparatus further comprises 
a watermarking logic for embedding digital watermarks in 
said object data separated from said contents, wherein said 
separator separates said object data and said recognition 
data from said contents, said recognition logic recognizes 
said object data, based on said recognition data separated 
from said contents and on said recognition data read out 
from said recording medium, and said accounting logic 
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charges for said object data embedded with said digital 
watermarks . 

Preferably, a digital watermark is embedded in said object 
5 data, and the data charging apparatus further comprises a 

means for detecting if said object data is embedded with 
said digital watermark, wherein said separator separates 
said object data and said recognition data from said 
contents, said recognition logic recognizes said object 
10 data based on said recognition data separated from said 

contents and on said recognition data read out from said 
recording medium, and said accounting logic charges for 
^ said object data only if said object data is found to be 

embedded with said digital watermark. 

:J 15 

jE Preferably, said charging data recorded on said recording 

fl! medium contains at least payment data which indicates the 

:iL payment made in advance for the use of said object data, 

fU and said accounting logic charges for the use of said 

^ 20 object data within the limits of the amount indicated by 

.ijO said payment data contained in said charging data. 



Preferably, said charging data recorded on said recording 
medium further contains unit price data representing the 

25 accounting unit for the use of said object data and the 

price corresponding to the accounting unit, the data 
charging apparatus comprises an accounting unit detection 
logic for detecting unit accounting amount data which 
represents the amount of said accounting unit for the 

30 object data separated from said contents, and said 

accounting logic charges prices for the use of said object 
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data within the limits of the amount indicated by said 
payment data, based on said unit price data contained in 
said charging data read out and on the unit accounting 
amount data detected. 

5 

Preferably, said charging data recorded on said recording 
medium further contains unit price data representing the 
accounting unit for the use of said object data and the 
price corresponding to the accounting unit as well as 
10 accounting range data which represents the range of one 

billing, and the data charging apparatus comprises an 
,« accounting unit detection logic for detecting unit 

B accounting amount data which represents the amount of said 

^ accounting unit -for the object data separated from said 

\| 15 contents, and said accounting logic charges a price each 

^{f time for the use of said object data within the limits of 

m the amount indicated by said payment data, based on said 

;;- € unit price data contained in said charging . data read out 

jjnj and on the unit accounting amount data detected. 

O 20 

;ji The first content generator according to the present 

l O invention is made available to the user for pay and 

copyright information or the like are embedded as visible 
or invisible digital watermarks in the object data [for 
25 example, static or dynamic images or home or business 

programs (data program)] to be charged for. 

Furthermore, the first content generator generates digital 
contents which contain data programs embedded with digital 
30 watermarks as well as identifiers/identification numbers 

(recognition data) for recognition of the data programs, 
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and delivers them to users' computers via recording media, 
such as CD-ROMs or magneto -optical disks (MO) , or a 
network. 

The second content generator according to the present 
invention generates digital contents which contain said 
object data and said recognition data without embedding 
digital watermarks and delivers them to users' computers 
via recording media or a network . 

The recording medium, for example, is an IC card (smart 
card) which comprises nonvolatile memory such as flash 
memory as well as I/O contacts for exchanging data between 
this memory and external apparatus, stores the charging 
data necessary for charging the user for his/her use of 
digital contents, and supplies this data to outside. 

The charging data stored on the IC card (recording medium) 
contains, for example, recognition data, unit price data, 
payment data, and accounting range data. 

The recognition data, for example, is an identifier unique 
to each data program (object data) to be charged for, and 
corresponds to the above-mentioned recognition data added 
to data programs by the content generator. 

The unit price data represents, for example, the unit of 
measurement of data program usage (chargeable amount) and 
the price (in terms of counts) to be charged (unit amount 
of accounting) for certain units of data program usage. 
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The payment data represents, for example, the balance in 
the price or amount (count) the user paid for the use in 
advance to the owner of the data program. 

The accounting range data represents, for example, the 
one-time usage of a data program that causes the payment 
data to be reduced in the accounting process or the upper 
limit of one-time usage (upper or lower limit of 
accounting) . 

The first data charging apparatus according to the present 
invention extracts a data program and recognition data from 
digital contents which are generated by the first content 
generator according to the present invention and which 
contain recognition data as well as data programs embedded 
with digital watermarks representing copyright information 
or the like. 

Besides, the first data charging apparatus detects if the 
extracted data program is embedded with a digital watermark 
and makes the extracted data program available for use to 
the user only if the data program is embedded with a 
digital watermark. 

Furthermore, the first data charging apparatus charges the 
user for his/her use of the data program on a pay-per-use 
basis by using the extracted recognition data and the 
charging data read out from the IC card (recording medium) 
only if the object data is found to be embedded with the 
digital watermark. 
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The second data charging apparatus according to the present 
invention extracts a data program and recognition data from 
digital contents which are generated by the second content 
generator according to the present invention and which 
5 contain recognition data as well as data programs not 

embedded with a digital watermark. 

Besides, the second data charging apparatus makes the 
extracted data program available to the user after 
10 embedding a digital watermark in it. 

Furthermore, the second data charging apparatus charges the 
user for his/her use of the data program embedded with 
digital watermarks on a pay-per-use basis by using the 
15 extracted recognition data and the charging data read out 

from the IC card (recording medium) . 

In the first and second data charging apparatus according 
to the present invention, the data reading . and writing 
20 means are, for example, an apparatus called an IC card 

reader. 

The data reading means reads out the charging data recorded 
on an IC card (recording medium) and outputs it to another 
25 component (accounting means or the like) . 

The data writing means records the charging data (payment 
data) inputted from another component (accounting means or 
the like) to an IC card (recording medium) ., 
30 In the first and second data charging apparatus, the 

separator separates data programs embedded with digital 
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watermarks or not embedded with digital watermarks as well 
as recognition data from the digital contents which are 
generated by the content generator and supplied to users' 
computers via a CD-ROM or the like. 

5 

In the first and second data charging apparatus, the 
recognition means compares the recognition data read out, 
for example, from the IC card (recording medium) with the 
recognition data separated from the contents read out from 

10 the CD-ROM or the like, and decides that the data program 

separated from the contents is the data program recognized 
by these recognition data and that the data program is fit 
for accounting by means for the IC card inserted in the IC 
card reader (data reading and writing means) if the two 

15 kinds of recognition data match. 

In the first data charging apparatus, the. means for 
detecting a digital water mark determines if the separated 
data program is embedded with a digital watermark and makes 
20 the data program available to the user only if the data 

program is embedded with a digital watermark. 

In the second data charging apparatus, the means for 
embedding a digital watermark makes the separated data 
25 program available to the user after embedding a digital 

watermark in it. 

Thus, in both the first and second data charging apparatus, 
the data program provided to the user is embedded with a 
30 digital watermark, which protects the, copyright of the data 

program. 
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In the first and second data charging apparatus, for 
example, the accounting means charges for the use of a data 
program within the limits of the amount (count) indicated 
by the payment data contained in the charging data read 
5 out. 

In other words, the accounting means measures the usage 
(usage count, data volume, processing time, etc.) of the 
data program by the user at the time, based on the unit 
10 accounting amount data (chargeable amount) . 

Then, the accounting means limits the measured usage within 
the range of the usage indicated by the accounting range 
data (upper and lower limits of accounting) and calculates 
15 the price (count) to be charged for the usage at the time 

by using the unit price data (unit amount of accounting) . 

Furthermore, the accounting means subtracts the price 
(count) to be charged according to the usage at the time 
20 from the price (count) indicated by the payment data, and 

records the new payment data (count) resulting from the 
subtraction into the IC card (recording medium) via the 
data writing means. 

25 The data charging method according to the present 

invention, for generating contents which contain object 
data and recognition data used for the recognition of this 
object data, recording the charging data used to charge for 
said object data and the recognition data used for 

30 recognition of the object data, and charging for the use of 

said object data by using said charging data and said 
recognition data recorded, comprises the steps of reading 
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said recognition data and said charging data from said 
recording medium, separating said object data from said 
contents, recognizing said separated object data by means 
for said recognition data read out, charging for the use of 
said recognized object data by means for said charging data 
read out, and writing, as said charging data, the results 
of charging for the use of said recognized object data into 
said recording medium. 

Preferably, said contents are generated by embedding said 
object data with recognition data unique to this object 
data in the form of visible or invisible digital 
watermarks, said recognition data embedded in said contents 
as said digital watermarks are separated together with said 
object data from said contents, and said object data is 
recognized based on said recognition data separated from 
said contents and on said recognition data read out from 
said recording medium. 

In a content generator of a data charging system which 
records, on a recording medium, the charging data used for 
charging for the object data contained in contents and the 
recognition data used for recognition of the object data, 
and charges for the use of said object data by using said 
charging data and said recognition data; recorded; the first 
recording medium according to the present invention records 
a program which makes a computer execute the step of 
embedding said object data with recognition data used for 
recognition of this object data in the form of visible or 
invisible digital watermarks and the step of generating 
contents. 
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In a data charging apparatus of a data charging system 
which records, on a recording medium, the charging data 
used for charging for the object data contained in contents 
and the recognition data used for recognition of the object 
5 data, and charges for the use of said object data by using 

said charging data and said recognition data recorded; the 
second recording medium according to the present invention 
records a program which makes a computer execute the steps 
of reading said recognition data and said charging data 

10 from the recording medium, separating said object data from 

said contents, recognizing said separated object data by 
means for said recognition data read out, charging for the 
use of said recognized object data by means for said 
charging data read out, and writing, as said charging data, 

15 the results of charging for the use of said recognized 

object data into the recording medium. 

Before describing the data charging system according to the 
present invention in detail, a brief overview will be 
20 provided to illustrate the marking of data programs by 

means for so-called digital watermarking. 

With the development of network infrastructures including 
the Internet, the flow of digital information is growing 
25 remarkably in the world. Since digital information lends 

itself easily to duplication and fabrication, it is prone 
to illegal copying, which makes copyright protection an 
important issue. 

30 Conventionally, cryptographic techniques which excel in 

stability and security during data transfer are used for 
protection of digital information. Once the receiver of 
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encoded information has decoded it, however, it is not 
possible to prevent duplication of the decoded information. 

In view of this, to put a check on illegal copying and 
distribution of digital images, a variety of methods have 
been devised for embedding visible or invisible data 
(so-called digital watermarks) inseparably in image data. 

The marking technology (also known as data hiding or the 
like) by the use of such digital watermarks is designed to 
prevent the digital watermarks from losing effect even if 
the information embedded with the digital watermarks are 
modified, while preserving the quality of image data or the 
like. 

This marking technology has various applications including 
copyright protection and can be applied to a variety of 
digital information such as static images, dynamic images, 
and audio. 

With this marking technology, data available for various 
processes can also be embedded in digital information 
together with digital watermarks. 

Besides, this marking technology makes it possible to 
supply digital contents with embedded information separated 
to the users who have paid due prices, of supply the 
separated information to programs which, run various 
processes . 

Figure 1 illustrates the configuration of the data charging 
system 1 according to the present invention. 
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Figure 2 illustrates the configuration of the client 
machines 10 and server machines 16 shown in Figure 1. 

As shown in Figure 1, the data charging system 1 consists 
of, for example, m client machines (#1 to #i to #m) 10-1 to 
10 -i to 10 -m and n server machines (#1 to #j to #n) 16-1 to 
16 -j to 16 -n, connected through a communications network 
14. 

Hereafter, the client machines 10-1 to 10 -i to 10 -m and 
server machines 16-1 to 16 -j to 16 -n will be referred to 
collectively as the client machine 10 and the server 
machine 16, respectively, unless individual machines are 
addressed specifically. 

As shown in Figure 2, each of the client machine 10 and 
server machine 16 comprises a CPU 12; display/output unit 
140 comprising a CRT display, printer, etc.; storage device 
104; communications device 106; memory 108; and input 
device 14, which in turn comprises, for example, a mouse 
142, keyboard 144, card reader 146, etc. 

In short, both client machine 10 and server machine 16 have 
the configuration of . a typical computer with data 
communications functions. 

The client machine 10 and server machine 16 run different 
software: the server machine 16 runs a content generation 
program 300 (described later with reference to Figure 3) 
while the client machine 10 runs a watermarking/accounting 
program 200 (described later with reference to Figure 5) 
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In the data charging system 1 (Figure 1) , the server 
machine 16 generates contents with or without marking, 
which involves embedding digital watermarks in image data, 
various processing programs (data programs) , or the like, 
and then server machine 16 delivers (supplies) the contents 
to the client machine 10 via the communications network 15 
or by means for recording media 22 such as CD-ROM. 

The server machine 16 contains nonvolatile memory such as 
flash memory, writes charging data according to payments 
into an IC card (also known as a smart card or the like) 20 
equipped with terminals for reading from and writing into 
the nonvolatile memory externally, and provides the IC card 
to the user of the client machine 10 in the form of 
so-called electronic money. 

Also in the data charging system 1 (Figure 1) , the client 
machine 10 separates data programs from the digital 
contents delivered by the server machine 16, embeds digital 
watermarks in the data programs if the latter does not 
contain digital watermarks yet, and provides the data 
programs to the user. 

Or if the data programs are supposed to be embedded with 
digital watermarks, the client machine 10 provides each 
data program to the user only if a digital watermark is 
detected in it. 

The client machine 10 separates a symbol or number unique 
to each data program or an identifier which simply 
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indicates the type of the data program and then the client 
machine 10 provides it as recognition data for accounting. 

The client machine 10 also reads, by means for a card 
reader 146, the charging data which was recorded from the 
server machine 16 to the IC card 20 and provided as 
described above in the form of so-called electronic money, 
runs an accounting process, and writes the resulting 
charging data (count) into the IC card 20, 

For simplicity and clarification, the following 
illustrative example assumes that the data charging system 
1 handles only images and similar data, that the unit of 
measure for accounting is data volume (pixel count or frame 
count) , and that the recognition data simply represents the 
type of program, unless otherwise stated. 

Figure 3 shows the configuration of the content generation 
program 3 00 which runs on the server machine 16 of Figures 
1 and 2 . 

The content generation program 300 is provided to the 
server machine 16, having been recorded on the recording 
medium 22 (Figure 2) , for example, and then loaded into 
memory 10 8 . 

As shown in Figure 3, the content generation program 300 
consists of a digital -watermarking engine 380, 
transmitter/recorder unit 390, watermark information holder 
392, and charging data processor 394. 
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The digital -watermarking engine 380 comprises a 
static- image engine 3 82, audio engine 3 84, dynamic - image 
engine 386, and text engine 388, depending on the kinds of 
data to be included in the contents. 

5 

The charging data processor 394 comprises an accounting 
database (DB) 396 and charging data write unit 39 8. 

Figure 4 shows the watermark information added to contents 
10 by the content generation program 300 of Figures 1 and 2. 

By means for the above-mentioned components, the content 
generation program 300 generates static image data, audio 
data, dynamic image data, and text data (these data 

15 correspond to the data programs described so far and are 

also referred to generically as "chargeable data 11 ), which 
are recorded on the recording media 22 or provided by other 
communications nodes (other server machines 16, client 
machines 10, other computers not shown, etc.) through the 

20 communications network 15. 

The content generation program 300 generates digital 
contents, which consist of chargeable data with or without 
a digital watermark embedded, identifier (recognition data) 

25 which recognizes the kind of chargeable data, and watermark 

information (Figure 4) which varies depending on whether 
the chargeable data is embedded with a digital watermark . 
As shown in Figure 4, watermark information contains 
processing type data, embedment parameter data, and 

30 detection parameter data. 
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Of the watermark information, the processing type data is 
used to specify whether to embed digital watermarks in 
chargeable data or to separate charging data and 
recognition data from digital contents on the client 
machine 10 . 

In other words, if digital watermarks are not embedded in 
chargeable data when digital contents are generated, the 
content generation program 3 00 sets the processing type 
data in the watermark information indicating that an action 
be taken to embed digital watermarks in the chargeable 
data. 

Conversely, if digital watermarks are embedded in 
chargeable data when digital contents are generated, the 
content generation program 3 00 sets the processing type 
data in the watermark information indicating that an action 
be taken to detect if digital watermarks are embedded in 
the chargeable data. 

The embedment parameter data concerns the parameter used to 
embed digital watermarks in chargeable data on the client 
machine 10. 

The detection parameter data concerns the parameter used on 
the client machine 10 to detect digital watermarks in 
chargeable data contained in digital contents and separate 
the recognition data embedded as the digital watermarks 
from the original chargeable data not embedded with digital 
watermarks . 
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Figure 5 shows the charging data recorded on the IC card 2 0 
of Figure 1. 

The content generation program 300 records the charging 
data shown in Figure 5 on individual blocks of the IC card 
20 if the user of the client machine 10 pays the prices for 
the use of chargeable data. The IC card 20 containing the 
charging data is given to the user who has paid prices and 
is inserted into the card reader 146 of the user's client 
machine 10. 

As shown in Figure 5, the charging data recorded on each 
block of the IC card . 20 contains the identifier 
(recognition data) of a chargeable item (the same as 
chargeable data) , identifier of a chargeable amount, unit 
amount of accounting (unit price data) , upper and lower 
limits of accounting (accounting range data) , and count 
(payment data) . 

Of the charging data, the identifier (recognition data) of 
a chargeable item, which is the same as the recognition 
data contained in digital contents, identifies the kind of 
chargeable data. 

Of the identifier of a chargeable amount and unit amount of 
accounting (unit price data), the identifier of a 
chargeable amount represents the unit of usage of 
chargeable data, used for calculating the price of the 
chargeable data. 

In the data charging system 1, for example, the usage of 
static image data, audio data and dynamic image data, and 
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text data is measured in pixels, frames, and characters, 
respectively. 

. The unit amount of accounting (unit price data) represents 
5 the price (in terms of counts) that corresponds to certain 

units of chargeable data as measured by the identifier of 
the chargeable amount. 

In other words, the usage of chargeable data in terms of 
10 the identifier of a chargeable amount multiplied by the 

price (count) represented by the unit amount of accounting 
~ gives the price (count) to be charged for the use of the 

yy chargeable data. 

Cj 15 Of the upper and lower limits of accounting (accounting 

■W range data) , the lower limit of accounting represents the 

31 minimum usage handled in accounting on the client machine 

* 10. 

|3 20 In other words, on the client machine 10, no price is 

'if charged if the usage of chargeable data as measured in 

: J terms of the accounting unit is lower than the lower limit 

of accounting, and a price is charged only if the usage of 
chargeable data is equal to or higher than the lower limit 
25 of accounting. 

On the other hand, the upper limit of accounting represents 
the upper limit of one-time usage handled in accounting on 
the client machine 10. 

30 

In other words, on the client machine 10, after the 
one-time usage of chargeable data as measured in terms of 
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the accounting unit exceeds the upper limit of accounting, 
the price is not increased however much the usage may 
increase: the price which corresponds to the upper limit 
of accounting is used in accounting. 

The count corresponds to the balance in the price or amount 
prepaid by the client machine 10. 

More particularly, first the count that corresponds to the 
total amount prepaid by the user is written into the IC 
card 20, then each time the user uses the chargeable data 
represented by the recognition data of the given block, the 
balance reduced in accordance with the usage is written as 
a remaining count into the IC card 2 0 within the upper and 
lower limits of accounting. 

The watermark information holder 392 holds watermark 
information for static images, audio, dynamic images, and 
text and outputs it to the static -image engine 3 82, audio 
engine 384, dynamic- image engine 386, and text engine 388,' 
respectively. 

In the digital -watermarking engine 380, the static- image 
engine 382 embeds a digital watermark, as required, in the 
static image data fed from outside as chargeable data, adds 
the watermark information for static images (Figure 4) held 
in the watermark information holder 392 as well as 
recognition data to generate digital contents of static 
images, and outputs them to the transmitter/recorder unit 
390. 
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The audio engine 384 embeds a digital watermark, as 
required, in the audio data fed from outside as chargeable 
data, adds the watermark information for audio (Figure 4) 
held in the watermark information holder 392 as well as 
recognition data to generate digital contents of audio, and 
outputs them to the transmitter/recorder unit 390. 

The dynamic- image engine 3 86 embeds a digital watermark, as 
required, in the dynamic image data fed from outside as 
chargeable data, adds the watermark information for dynamic 
images (Figure 4) held in the watermark information holder 
392 as well as recognition data to generate digital 
contents of dynamic images, and outputs, them to the 
transmitter/recorder unit 390. 

The text engine 388 embeds a digital watermark, as 
required, in the text data fed from outside as chargeable 
data, adds the watermark information for text (Figure 4) 
held in the watermark information holder 392 as well as 
recognition data to generate digital contents of text, and 
outputs them to the transmitter/recorder unit 390. 

The transmitter/recorder unit 390 delivers the digital 
contents input from the digital -watermarking engine 380, to 
each of the client machines 10 via the communications 
network 15 or on the recording medium 22.. 

The accounting database 396 stores the identifier of the 
chargeable item, identifier of the chargeable amount, unit 
amount of accounting, upper limit of accounting, and lower 
limit of accounting (Figure 5) for specified items of the 
chargeable data delivered by the server machine 16. 
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The accounting database 396 also accepts the user's 
operation on input devices 14 of the server machine 16, 
including the inputs of information about the chargeable 
5 data for which prices have been paid by the user of the 

client machine 10, and outputs the identifier of the 
chargeable item, identifier of the chargeable amount, unit 
amount of accounting, upper limit of accounting, and lower 
limit of accounting for the specified items of chargeable 
10 data to the charging data write unit 398. 

The charging data write unit 398 accepts the user's 
:fl operation on input devices 14 of the server machine 16, 

;;|! including the specification of the count that corresponds 

Sj 15 to the payment made by the user of the client machine 10, 

and writes the specified count together with the data 
fh received from the accounting database 396. into the IC card 

20 via the card reader 146 as charging data (Figure 5) . 

(Q 20 The IC card 2 0 into which charging data has been written by 

7? the charging data write unit 398 is handed to the user of 

the client machine 10 who has paid the price and is 
inserted into the card reader 146 of . the client machine 10. 

25 Figure 6 shows the configuration of the 

watermarking/accounting program 200 which runs on the 
client machine 10 of Figures 1 and 2. 

Figure 7 shows the configuration of the accounting engine 
30 230 shown in Figure 6. 
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The watermarking/accounting program 200 is provided to the 
client machine 10, having been recorded on. the recording 
medium 22, and is loaded into memory 108 (Figure 2) for 
execution, as is the case with the content generation 
program 3 00 . 

As shown in Figure 6, the watermarking/accounting program 
200 consists of a digital - content receiving module 202, 
accounting module 210, and watermark information database. 

The accounting module 210 includes a digital -watermarking 

: ^ engine 220 and accounting engine 230. 

X The digital -watermarking engine 220 comprises a 

\f 15 static-image engine 222, audio engine 224, dynamic- image 

^ engine 226, and text engine 228. 

- The accounting engine 230 comprises an accounting 

|H information selector 232, billing processor 234, and IC 

jp 20 card interface (IF) 236, as shown in Figure 7 . 

By means for the above-mentioned components, the 
watermarking/accounting program 200 separates accounting 
information (Figure 4) from the digital contents generated 
25 by the server machine 16, further separates chargeable data 

and recognition data from the digital contents by using the 
separated accounting information, and provides the 
chargeable data with a digital watermark embedded in it to 
the user of the client machine 10. 
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Also, the watermarking/accounting program 200 reads 
charging data (Figure 5) from the IC card 2 0 inserted in 
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the card reader 146 (Figure 2) and charges prices for the 
use of chargeable data on a pay-per-use basis (according to 
the usage count, data volume, etc.) by using the charging 
data and the recognition data separated from the digital 
contents. 

The digital -content receiving module 202 receives digital 
contents recorded on the recording media 22 or digital 
contents delivered from the server machine 16 via the 
communications network 15, identifies the kinds of the 
chargeable data (static image, audio, dynamic image, and 
text) , and outputs the digital contents containing static 
image data, audio data, dynamic image data, and text data 
to the static-image engine 222, audio engine 224, 
dynamic- image engine 226, and text engine 228 of the 
digital -watermarking engine 220, respectively, according to 
the kind of the chargeable data. 

The kinds of chargeable data contained in digital contents 
can be identified easily by checking the file formats or 
file name extensions of the chargeable- data files contained 
in the digital contents. 

In the following illustrative example, data used to 
identify the kinds of chargeable data is treated as 
recognition data. 

The watermark information holder 248 holds the detection 
parameter which corresponds to the detection parameter data 
of the watermark information (Figure 4) contained in 
digital contents and the embedment parameter which 
corresponds to the embedment parameter data, and outputs 
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the parameters to the static- image engine 222, audio engine 
224, dynamic- image engine 226, or text engine 228 of the 
digital -watermarking engine 220, respectively, according to 
the kind of the chargeable data (static image, audio, 
5 dynamic image, or text) . 

In the static- image engine 222, audio engine 224, 
dynamic- image engine 226, or text engine 228 of the 
digital -watermarking engine 220, the detection parameter is 
10 used to detect digital watermarks in chargeable data and 

the embedment parameter is used to embed digital watermarks 
in chargeable data. 

In the digital -watermarking engine 220, the static -image 
15 engine 222 receives digital contents containing chargeable 

static image data through the digital - content receiving 
module 202, acquires the parameter necessary for detection 
of digital watermarks from the watermark information holder 
248 by using the detection data contained in the watermark 
20 information (Figure 4) contained in the received digital 

contents, and separates recognition data and chargeable 
data (static image data) from the digital contents. 

The static-image engine 222 outputs the separated static 
25 image data to the billing processor 234 (Figure 7) . 

Figure 8 shows the content information output by the 
digital -watermarking engine 22 0 of Figure 6 to the 
accounting engine 230. 
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As shown in Figure 8, the static -image engine 222 outputs 
the identifier (recognition data) and file size of the 
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chargeable item (static image data) separated from digital 
contents together with content - specif ic information (pixel 
count) to the accounting engine 230 as content information. 

5 The content- specif ic information, which varies with the 

kind of chargeable data as shown in Figure 8, contains data 
about the unit of measure (which corresponds to the 
identifier of the chargeable amount in charging data 
(Figure 5)) used for measuring the chargeable data as well 
10 as data about the amount (expressed in terms of this unit) 

of the chargeable data contained in digital contents. 

The audio engine 224 (Figure 6) receives digital contents 
containing chargeable audio data through the 

15 digital -content receiving module 202, acquires the 

parameter necessary for detection of digital watermarks 
from the watermark information holder 248 by using the 
detection parameter contained in the watermark information 
(Figure 4) contained in the received digital contents, and 

20 separates recognition data and chargeable data (audio data) 

from the digital contents. 

The audio engine 224 outputs the separated audio data to 
the billing processor 234 (Figure 7) . 

25 

As shown in Figure 8, the audio engine 224 outputs the 
identifier (recognition data) and file size of the 
chargeable item separated from digital contents together 
with content- specif ic information (frame count) determined 
30 according to the kind (audio data) of chargeable data 

identified by the digital - content receiving module 202, to 
the accounting engine 230 as content information. 
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The dynamic- image engine 226 receives digital contents 
containing chargeable dynamic image data from an input 
device 210, acquires the parameter necessary for detection 
of digital watermarks from the watermark information holder 
248 by using the detection parameter contained in the 
watermark information (Figure 4) contained in the received 
digital contents, and separates recognition data and 
chargeable data (dynamic image data) from the digital 
contents. 

The dynamic- image engine 226 outputs the separated dynamic 
image data to the billing processor 234 (Figure 7). 

As shown in Figure 8, the dynamic- image engine 226 outputs 
the identifier (recognition data) and file size of the 
chargeable item separated from digital contents together 
with content- specif ic information (frame count) determined 
according to the kind (dynamic image data) of chargeable 
data identified by the digital -content receiving module 
2 02, to the accounting engine 23 0 as content information. 

The text engine 228 (Figure 6) receives digital contents 
containing chargeable text data through the digi tal - content 
receiving module 202, acquires the parameter necessary for 
detection of digital watermarks from the watermark 
information holder 24 8 by using the detection parameter 
contained in the watermark information (Figure 4) contained 
in the received digital contents, and separates recognition 
data and chargeable data (text data) from the digital 
contents. 
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The text engine 22 8 outputs the separated text data to the 
billing processor 234 (Figure 7) . 

As shown in Figure 8, the text engine 22 8 outputs the 
5 identifier (recognition data) and file size of the 

chargeable item separated from digital contents together 
with content- specif ic information (character count) 
determined according to the kind (text data) of chargeable 
data identified by the digital -content receiving module 
10 202, to the accounting engine 230 as content information. 

If the processing type in watermark information (Figure 4) 
is embedment, the static- image engine 222, audio engine 
224, dynamic- image engine 226, and text engine 22 8 receive 

15 the digital contents containing respective chargeable data 

through the digital - content receiving module 202, acquire 
the embedment parameter necessary for processing from the 
watermark information holder 24 8 by using the embedment 
parameter data contained in the received digital contents, 

20 embed a digital watermark in the chargeable data, and 

output the chargeable data to the billing processor 234 
(Figure 7) of the accounting engine 23 0 (Figure 6-) . 

If the processing type in watermark information (Figure 4) 
25 is detection, the static -image engine 222, audio engine 

224, dynamic- image engine 226, and text engine 22 8 receive 
the digital contents containing respective chargeable data 
through the digital - content receiving module 202, acquire 
the embedment parameter necessary for processing from the 
30 watermark information holder 24 8 by using, the detection 

parameter data contained in the received digital contents, 
detect whether the chargeable data is : embedded with a 
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digital watermark, and output the chargeable data to the 
billing processor 234. 

The accounting engine 230 runs an accounting process for 
pay-per-use charging for chargeable data: subtracts the 
usage count of chargeable data from the count contained in 
the charging data by using the content information (Figure 
8) supplied from the digital -watermarking engine 220 and 
charging data (Figure 5) read out from the IC card 20 and 
writes the result into the IC card 20. 

The IC card IF 236 reads charging data (Figure 5) from the 
IC card 20 inserted in the card reader 146. and outputs it 
to the accounting information selector 232. 

Also, the IC card IF 236 writes the billing output (count 
reduced as a result of billing) received from the billing 
processor 234 into the IC card 20. 

The accounting information selector 23 2 compares the 
identifier (recognition data) of the chargeable item 
contained in the content information (Figure 8) received 
from the digital -watermarking engine 220 and the identifier 
(recognition data) of the chargeable item contained in the 
charging data (Figure 5) read out from each block of the IC 
card 20, reads the charging data from the block that 
contains the same identifier (recognition data) as the one 
contained in the content information, and outputs it 
together with the content information to the billing 
processor 234. 
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The billing processor 234 runs an accounting process, based 
on the charging data of the one specific block received 
from the accounting information selector 232 as well as on 
the content information, changes the count in the charging 
5 data, and writes the charging data into the appropriate 

block of the IC card 20 via the IC card IF 236. 

The billing processor 234 permits the use of the chargeable 
data output by the digital -watermarking engine 220 only if 
10 the watermarking and accounting processes have been run 

properly. 

With reference to Figures 9 to 18, a detailed description 
;;t of the overall accounting process run by the 

Cj 15 watermarking/accounting program 2 00 will be provided below. 

■si— 

Jj] Figure 9 is a flowchart showing the watermarking process 

* and detection/removal process (digital -watermarking 

JJ! process: S10) performed by the digital - content receiving 

O 20 module 202 and digital -watermarking engine 220 of Figure 6. 

J Figures 10 to 13 are flowcharts showing the watermarking 

processes (S40, S42, S44, and S46 shown in Figure 9) of 
digital contents containing static image data, audio data, 
25 dynamic image data, and text data, respectively. 

Figures 14 to 16 are flowcharts showing the processes (S30, 
S32, and S34 shown in Figure 9) of generating content 
information (Figure 8) from digital contents containing 
30 static image data, audio data or dynamic image data, and 

text data, respectively. 
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As shown in Figure 9, in Step 100 (S100) , the 
digital -content receiving module 2 02 (Figure 6) receives 
the digital contents delivered from the client machine 10. 

5 In Step 102 (S102) , the digital -content receiving module 

2 02 determines whether the received digital contents 
contain chargeable data that can be watermarked, i.e., in 
this embodiment, it determines whether the received digital 
contents contain static image data, audio data, dynamic 
10 image data, or text data, and, if they do, the process 

advances to any of S40, S42, S44, or S46 (Figures 10 to 13) 
or any of S30, S32, or S34 (Figures 14 to 16) depending on 
the kind of data contained. 

15 First, the watermarking process (S40 in Figures 9 and 10) 

in case digital contents contain static images will be 
described. 

As shown in Figure 10, the digital - content receiving module 
20 202 outputs the digital contents to the static- image engine 

222 of the digital -watermarking engine 220 in Step 400 
(S400). 

In Step 402 (S402) , the static-image engine 222 separates 
25 static image data and watermark information (Figure 4) from 

the digital contents and determines the processing type 
data from the separated watermark information. If the 
processing type data are embedment of a digital watermark, 
the process advances to S404. Otherwise, it goes to S408. 



30 



In Step 404 (S404) , the static-image engine 222 extracts 
embedment parameter data from the watermark information and 
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reads out the embedment parameter that corresponds to this 
embedment parameter data from the watermark information 
holder 248 . 

In Step 406 (S406) , the static-image engine 222 embeds a 
digital watermark for static images in the static image 
data, and then advances to S104 (Figure 9) . 

In Step 408 (S408) , the static-image engine 222 extracts 
detection parameter data from the watermark information and 
reads out the detection parameter that corresponds to this 
detection parameter data from the watermark information 
holder 248. 

In Step 410 (S410) , the static- image engine 222 detects a 
digital watermark for static images in the static image 
data, and then advances to S104 (Figure 9) . 

Next, the watermarking process (S42 in Figures 9 and 11) in 
case digital contents contain audio data will be described. 

As shown in Figure 11, the digital - content receiving module 
202 outputs digital contents to the audio, engine 224 of the 
digital -watermarking engine 220 in Step 400 (S400) . 

In Step 402 (S402) , the audio engine 224 separates static 
image data and watermark information (Figure 4) from the 
digital contents and determines the processing type data 
from the separated watermark information. If the 
processing type data are embedment of a digital watermark, 
the process advances to S404. Otherwise, it goes to S408. 
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In Step 404 (S404) , the audio engine 224 extracts embedment 
parameter data from the watermark information and reads out 
the embedment parameter that corresponds . to this embedment 
parameter data from the watermark information holder 248. 

5 

In Step 420 (S420) , the audio engine 224 embeds a digital 
watermark for audio in the audio data, and then advances to 
S104 (Figure 9) . 

10 In Step 408 (S408) , the audio engine 224 extracts detection 

parameter data from the watermark information and reads out 
the detection parameter that corresponds to this detection 
parameter data from the watermark information holder 248. 

15 In Step 422 (S422) , the audio engine 224 detects a digital 

watermark for audio in the audio data, and then advances to 
S104 (Figure 9) . 

Now, the watermarking process (S44 in Figures 9 and 12) in 
20 case digital contents contain dynamic images will be 

described. 

As shown in Figure 12, the digital -content receiving module 
202 outputs the digital contents to the dynamic- image 
25 engine 226 of the digital -watermarking engine 220 in Step 

400 (S400) . 

In Step 402 (S402) , the dynamic- image engine 226 separates 
static image data and watermark information (Figure 4) from 
30 the digital contents and determines the. processing type 

data from the separated watermark information. If the 
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processing type data are embedment of a watermark, the 
process advances to S404. Otherwise, it goes to S408. 

In Step 404 (S404) , the dynamic- image engine 226 extracts 
5 embedment parameter data from the watermark information and 

reads out the embedment parameter that corresponds to this 
embedment parameter data from the watermark . information 
holder 248. 

10 In Step 440 (S440) , the dynamic- image engine 226 embeds a 

digital watermark for dynamic images in the dynamic image 
^ data, and then advances to S104 (Figure 9) . 

■'"M 

;sF In Step 408 (S408) , the dynamic- image engine 226 extracts 

15 detection parameter data from the watermark information and 

M reads out the detection parameter that corresponds to this 

;jjn detection parameter data from the watermark information 

* holder 24 8. 

■ : p 5 20 In Step 442 (S442) , the dynamic- image engine 226 detects a 

S digital watermark for dynamic images in the dynamic image 
data, and then advances to S104 (Figure 9) . 

Now, the watermarking process (S46 in Figures 9 and 13) in 
25 case digital contents contain text data will be described. 

As shown in Figure 13, the digital -content receiving module 
202 outputs the digital contents to the text engine 228 of 
the digital -watermarking engine 220 in Step 400 (S400) . 



In Step 402 (S402) , the text engine 228 separates static 
image data and watermark information (Figure 4) from the 
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digital contents and determines the processing type data 
from the separated watermark information. If the 

processing type data are embedment of a watermark, the 
process advances to S404. Otherwise, it. goes to S408. 

In Step 404 (S404) , the text engine 228 extracts embedment 
parameter data from the watermark information and reads out 
the embedment parameter that corresponds to this embedment 
parameter data from the watermark information holder 248. 

In Step 460 (S460) , the text engine 228 embeds a digital 
watermark for text in the text data, and then advances to 
S104 (Figure 9) . 

In Step 408 (S408) , the text engine 228 extracts detection 
parameter data from the watermark information and reads out 
the detection parameter that corresponds to this detection 
parameter data from the watermark information holder 248. 

In Step 462 (S462) , the text engine 228 detects a digital 
watermark for text in the text data, and then advances to 
S104 (Figure 9) . 

Now, a description will be given of the process (S30 in 
Figures 9 and 14) of generating the content information 
shown in Figure 8 from digital contents containing static 
image data. 

As shown in Figure 14, in Step 300 (S300) , the static-image 
engine 222 of the digital -watermarking engine 220 (Figure 
6) acquires, as recognition data, for example, the file 
name extension of the chargeable data (static image data) 
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separated from the digital contents or the data on the kind 
of the chargeable data attached separately to the digital 
contents. 

5 In Step 302 (S302) , the static - image engine 222 measures 

the file size (data volume) of the chargeable data (static 
image data) . 

In Step 304 (S304) , the static-image engine 222 acquires 
10 the number of scan lines (number of rows) in the vertical 

direction and number of pixels (number of columns) in the 
horizontal direction, of the static image by, for example, 
reading the header information attached to the chargeable 
data (static image data) file, 

15 

In Step 306 (S306) , the static-image engine 222 calculates 
the pixel count (number of pixels) of the static image data 
(chargeable data) by, for example, multiplying the row 
count (number of rows) and column count (number of columns) 
20 of the static image determined in S304. 

In Step 308 (S308) , the static-image engine 222 sets the 
recognition data acquired in S300 as the identifier of the 
chargeable item in the content information . (Figure 8). 

25 

In Step 310 (S310) , the static-image engine 222 sets the 
file size acquired in S302 in the content information. 

In Step 312 (S312) , the static-image engine 222 sets the 
30 pixel count acquired in S3 06 in the content information to 

complete the content information for the static image. The 
static-image engine 222 outputs the completed content 
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information to the accounting information selector 232 
(Figure 7) of the accounting engine 23 0 and advances to the 
accounting process S20 (Figures 9 and 17) . 

5 Now, a description will be given of the process (S32 in 

Figures 9 and 15) of generating the content information 
shown in Figure 8 from digital contents containing audio or 
dynamic image data. 

10 As shown in Figure 15, in Step 300 (S300) , the audio engine 

224 or dynamic- image engine 226 of the digital -watermarking 
engine 220 (Figure 6) acquires, as recognition data, for 
example, the file name extension of the chargeable data 
(audio or dynamic image data) or the data on the kind of 

15 the chargeable data attached separately to the digital 

contents. 

In Step 302 (S302) , the audio engine 224 or dynamic- image 
engine 226 measures the file size (data volume) of the 
20 chargeable data (audio or dynamic image data). 

In Step 320 (S320) , the audio engine 224 or dynamic- image 
engine 22 6 acquires the frame count of the audio or dynamic 
image data by, for example, reading the header information 
25 attached to the chargeable data (audio or dynamic image 

data) file. 

In Step 308 (S308) , the audio engine 224 or dynamic- image 
engine 226 sets the recognition data acquired in S3 00 as 
30 the identifier of the chargeable item in the content 

information (Figure 8) . 
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In Step 310 (S310) , the audio engine 224 or dynamic- image 
engine 226 sets the file size acquired in S302 in the 
content information. 

In, Step 324 (S324) , the audio engine 224 or dynamic - image 
engine 226 sets the frame count acquired in S320 in the 
content information to complete the content information for 
the audio or dynamic- image. The audio engine 224 or 
dynamic- image engine 226 outputs the completed content 
information to the accounting information selector 232 
(Figure 7) of the accounting engine 230 and advances to the 
accounting process S2 0 (Figures 9 and 17) . 

Now, a description will be given of the process (S34 in 
Figures 9 and 16) of generating the content information 
shown in Figure 8 from digital contents containing text 
data. 

As shown in Figure 16, in Step 300 (S300) , the text engine 
228 of the digital -watermarking engine 220 (Figure 6) 
acquires, as recognition data, for example, the file name 
extension of the chargeable data (text data) or the data on 
the kind of the chargeable data attached separately to the 
digital contents. 

In Step 302 (S302) , the text engine 228 measures the file 
size (data volume) of the chargeable data (text data) . 

In Step 340 (S340) , the text engine. 228 acquires the 
character count of the text data by, for example, reading 
the header information attached to the chargeable data 
(text data) file. 



JA998-216 



In Step 308 (S308) , the text engine 228 sets the 
recognition data acquired in S300 as the identifier of the 
chargeable item in the content information (Figure 8) . 

5 

1 In Step 310 (S310) , the text engine 228 sets the file size 

acquired in S3 02 in the content information. 

In Step 342 (S342) , the text engine 228 sets the character 
10 count acquired in S340 in the content information to 

complete the content information for the text. The text 
engine 22 8 outputs the completed content information to the 
accounting information selector 232 (Figure 7) of the 
accounting engine 23 0 and advances to the accounting 
15 process S20 (Figures 9 and 17) . 

Now, the accounting process will be described with 
reference to Figures 17 and 18. 

20 Figure 17 is a flowchart of the accounting, process (S20) 

shown in Figure 9 . 

Figure 18 is a flowchart of the billing process (S24) shown 
in Figure 17 . 



25 
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As shown in Figure 17, in Step 200 (S200) , the accounting 

information selector 232 (Figure 7) acquires the content 

information (Figure 8) generated in any of..S30 to S34 

(Figures 14 to 16) . 
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In Step 204 (S204) , the accounting information selector 232 
reads the first block of the charging data (Figure 5) from 
the IC card 20 (Figures 2 and 6) via the IC card IF 236. 

5 In Step 206 (S206) , the accounting information selector 232 

compares the recognition data (identifier of the chargeable 
item) contained in one block of the charging data (Figure 
4) read from IC card 20 in S204 or S222 with the 
recognition data in the content information (Figure 8) 
10 received from the digital -watermarking engine 220. 

In Step 208 (S208) , the accounting information selector 232 
determines whether the comparison in S206 resulted in a 
match. If it did, the selector advances to S210. 
15 Otherwise, it goes to S218. 

In Step 210 (S210) , the accounting information selector 232 
acquires content- specif ic information from the content 
information which was found in S208 to contain a matching 
20 identifier. 

In Step 212 (S212) , the accounting information selector 232 
acquires the identifier of the chargeable amount from the 
chargeable data which was found in S2 08 to contain a 
25 matching identifier, and compares it with the 

content- specif ic information acquired in S210. If the 
content- specif ic information and chargeable amount match, 
the accounting information selector 232 advances to S214. 
Otherwise, it goes to S218. 



30 



In Step 214 (S214) , the accounting information selector 232 
determines whether the amount (chargeable amount) of 
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chargeable data in the digital contents indicated by the 
content- specif ic information in the content information is 
within the upper and lower limits of accounting contained 
in the charging data. 

If the amount of chargeable data is within the upper and 
lower limits of accounting, the accounting information 
selector 232 advances to S216. Otherwise, it goes to S218. 

In Step 216 (S216) , the accounting information selector 232 
outputs the charging data and content information which 
were found in S208 to contain matching identifiers to the 
billing processor 234 (Figure 7) . 

The accounting information selector 232 divides the 
chargeable amount which is indicated by the content 
information by the unit amount of accounting in the 
charging data to determine the count to be deducted (count 
billed) from the count in the charging data of the given 
block as the price charged for the use of the chargeable 
data contained in the digital contents, and then advances 
to S24 (the billing process) . 

In Step 218 (S218) , the accounting information selector 232 
determines whether the last charging data loaded is the 
charging data in the last block of the IC card 20. If it 
is, the accounting information selector 232 advances to 
S220. Otherwise, it goes to S222. 

In Step 220 (S220) , the accounting information selector 232 
sets an error code in the return value to the watermarking 
process S10, and then returns to S106 in Figure 9. 
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The billing process S24 shown in Figure 17 will be 
described below. 

5 As shown in Figure 18, in Step 240 (S240) , the billing 

processor 234 reads out the count billed which was 
calculated in S216 of Figure 17, from the accounting 
information selector 232. 



10 In Step 242 (S242) , the billing processor 234 determines 

whether the remaining count in the smart card (charging 
data) input in the accounting information selector 232 is 
equal to or smaller than the count billed. If it is, the 
billing processor 234 advances to S244. Otherwise, it goes 

15 to S248. 



In Step 244 (S244) , the billing processor 234 subtracts the 
count billed calculated in S216 from the count in the 
charging data via the IC card IF 236. 

20 

In Step 246 (S246) , the billing processor 234 resets the 
error code in the return value to the watermarking process 
S10 and returns to S106 in Figure 9 if the result of 
calculation in S244 is 0 or larger. Otherwise, it goes to 
25 S248. 

In Step 248 (S248) , the billing processor 234 sets an error 
code in the return value to the watermarking process S10, 
discards the result of the subtraction performed in S244, 
30 and then returns to S106 in Figure 9. 

Referring to Figure 9 again. 



JA998-216 



-48- 




In Step 104 (S104) , the billing processor 234 determines if 
the watermarking process was run successfully by the 
digital -watermarking engine 220. If it was, the billing 
5 processor 234 advances to S106. Otherwise, it finishes 

processing . 

In Step 106 (S106) , if the return value from another 
process (S20 or S24 in Figures 17 and 18) is an error code, 
10 the billing processor 234 goes to S110 having determined 

that accounting was unsuccessful. Otherwise, it advances 
to S108 having determined that accounting was successful. 

In Step 108 (S108) , the billing processor 234 writes the 
15 result of subtraction obtained in S244 of the billing 

process S24 shown in Figure 18 into the IC card 20 as the 
charging data of the block which was found to contain a 
matching identifier of chargeable data in S208 of the 
accounting process S20 shown in Figure 17. 

20 

In the processes described above, the billing processor 234 
reads out the chargeable data (static image data, audio 
data, dynamic image data, or text data) that has 
successfully gone through the watermarking process or 
25 detection process and accounting process from the 

digital -watermarking engine 220. 

Furthermore, the billing processor 234 stores the read 
chargeable data in memory 108, and then. records it on the 
30 recording medium 22 via the storage device 104 or displays 

it on the display/output unit 140 for use by the user. 
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In Step 110 (S110) , the billing processor 234 controls the 
digital -watermarking engine 220 by activating the reset 
signal to discard the chargeable data obtained in the 
watermarking process (S40 to S46 in Figures 10 to 13) . 

The overall operation of the data charging system 1 will be 
described below with reference to figures. 

On the server machine 16 (Figures 1 and 2) , the content 
generation program 300 (Figure 3) embeds watermarks in 
chargeable data such as static image data, audio data, 
dynamic image data, and text data and generates digital 
contents which contain the chargeable data embedded with 
the watermarks, recognition data indicating the kinds of 
the chargeable data, and watermark information (Figure 4) 
for the case where watermarks are embedded in chargeable 
data. 

Or the content generation program 300 does not embed 
watermarks in chargeable data and generates digital 
contents which contain the chargeable data, recognition 
data, and watermark information (Figure 4) for the case 
where watermarks are not embedded in chargeable data. 

The digital contents generated by the content generation 
program 300 are supplied to the client machine 10 through 
the recording medium 22, communications network 15, etc. 

If the user of the client machine 10 has paid the prices 
for chargeable data, the content generation program 300 
records the charging data (Figure 5) in the appropriate 
blocks of the IC card 20. The IC card 20 with charging 
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data recorded is given to the user who has paid the prices 
and is inserted into the card reader 146 of this user's 
client machine 10. 



5 On the client machine 10 (Figures 1 and 2) , the 

digital -content receiving module 202 (Figure 6) receives 
the digital contents supplied from the server machine 16 
and outputs digital contents containing static image data, 
audio data, dynamic image data, and text data to the 
10 static- image engine 222, audio engine 224, dynamic- image 

engine 226, and text engine 228 of the digital -watermarking 
engine 220, respectively. 

In the digital -watermarking engine 220, the static- image 
15 engine 222, audio engine 224, dynamic- image engine 226, and 

text engine 228 receive the digital contents received from 
the digital -content receiving module 202, obtain the 
parameter necessary for detection of digital watermarks 
from the watermark information holder 248 by using the 
20 detection data contained in the watermark information 

(Figure 4) contained in the received digital contents, 
separate recognition data and chargeable data from the 
digital contents, and output separated static image data to 
the billing processor 234 (Figure 7) . 

25 

The static -image engine 222, audio engine 224, 
dynamic- image engine 226, and text engine 228 also output 
the recognition data of chargeable data, the file size of 
the separated chargeable data, and content- specif ic 
30 information as content information (Figure 8) to the 

accounting engine 230. 



JA998-216 



-51- 



Further, the static -image engine 222 , audio engine 224, 
dynamic- image engine 226, and text engine 228 embed or 
detect a digital watermark in the chargeable data according 
to the processing type indicated by . the watermark 
5 information (Figure 4) , as shown in Figures 9 to 13 

As shown in Figure 17, the accounting information selector 
232 (Figure 7) of the accounting engine 230 (Figure 6) 
compares the identifier (recognition data) of chargeable 
10 data contained in content information (Figure 8) with that 

contained in charging data (Figure 5) and outputs any 
matching content information and charging data to the 
billing processor 234. 

15 The billing processor 234 runs an accounting process as 

shown in Figure 18 based on the charging data and content 
information supplied from the accounting information 
selector 232, changes the count in the charging data, 
writes the charging data into the appropriate. block of the 

20 IC card 2 0 via the IC card IF 236, and then provides the 

chargeable data output by the digital -watermarking engine 
220 to the user only if the watermarking process and 
billing process have been successful. 

25 Instead of recording different count data on each block, 

count data common to all the blocks may be recorded on the 
IC card 2 0 and shared among the accounting processes of 
different chargeable data. 

30 As described above, the data charging system, content 

generator, data charging apparatus, and data charging 
method according to the present invention make it possible 
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to charge the user for his/her use of digital, contents in 
an easy and reliable manner by the use of a smart card. 

Also, the data charging system, content generator, data 
5 charging apparatus, and data charging method according to 

the present invention make it possible to charge the user 
for his/her use of digital contents on a pay-per-use basis. 

Furthermore, the data charging system, content generator, 
10 data charging apparatus, and data charging method according 

to the present invention make it possible to charge the 
user for his/her use of digital contents in an easy and 
reliable manner while preventing unauthorized use of 
digital contents by means for digital watermarking or the 
15 like. 

While the invention has been particularly shown and 
described with respect to preferred embodiments thereof, it 
will be understood by those skilled in the art that the 
20 foregoing and other changes in form and details may be made 

therein without departing form the spirit and scope of the 
invention . 
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